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We discuss in detail algorithms for implementing tensor network renormalization (TNR) for the 
study of classical statistical and quantum many-body systems. Firstly, we recall established tech¬ 
niques for how the partition function of a 2D classical many-body system or the Euclidean path 
integral of a ID quantum system can be represented as a network of tensors, before describing how 
TNR can be implemented to efficiently contract the network via a sequence of coarse-graining trans¬ 
formations. The efficacy of the TNR approach is then benchmarked for the 2D classical statistical 
and ID quantum Ising models; in particular the ability of TNR to maintain a high level of accuracy 
over sustained coarse-graining transformations, even at a critical point, is demonstrated. 
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I. INTRODUCTION 

Tensor network renormalization^ (TNR) is a recently 
introduced approach for coarse-graining tensor networks, 
with application to the efficient simulation of classical 
statistical many-body systems and quantum many-body 
systems. A key feature of TNR that differentiates it 
from previous methods for coarse-graining tensor net¬ 
works, including Levin and Nave’s tensor renormaliza¬ 
tion group^ (TRG) as well as other subsequently devel¬ 
oped approaches^riS, is the use of unitary disentanglers 
in TNR that function to allow removal of all short-ranged 
correlation at each length scale. This proper removal 
of short-ranged correlation allows TNR to resolve sig¬ 
nificant computational and conceptual problems encoun¬ 
tered by previous methods. 

Despite the success and usefulness of TRG, it is known 
to suffer a computational breakdown when at or near a 
critical pointi^, where the cost of maintaining at accurate 
effective description of the system grows quickly with 
coarse-graining step, due to the accumulation of short- 
ranged correlation. The use of disentanglers allows TNR 
to prevent this accumulation, such that TNR can main¬ 
tain an description over repeated coarse-graining steps, 
or equivalently for very large system sizes, without re¬ 
quiring a growth of computational cost. Previous meth¬ 
ods for coarse-graining tensor networks, such as TRG, 
are also conceptually problematic if they are to be inter¬ 
preted as generating a renormalization groupii (RG) flow 
in the space of tensors, in that they do not reproduce the 
expected structure of RG fixed points. This flaw was par¬ 
tially resolved with the proposal of tensor entanglement 
filtering renormalization (TEFR) in Refill, which repro¬ 
duces the proper structure of gapped RG fixed points. 
On the other hand, TNR fully resolves these problems, 
reproducing the proper structure of gapped fixed points 
as well as producing scale-invariant fixed points when 
applied to critical systems corresponding to discrete ver- 
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sions of conformal field theorie a^^d^ (CFT), thus cor¬ 
rectly realizing Wilsons RG ideasi^ on tensor networks. 
By capturing scale-invariance, and producing a rescaling 
transformation for the lattice consistent with conformal 
transformations of the field theoryi^, TNR can produce 
an accurate description of the fixed-point RG map, from 
which the critical data characterizing the GFT can then 
be extracted. 

The use disentanglers in TNR, and their success in pre¬ 
venting the retention and accumulation of short-ranged 
degrees of freedom, is closely related to the use and suc¬ 
cess of disentanglers in entanglement renormalizationi^ 
(ER) and in the multi-scale entanglement renormaliza¬ 
tion ansatiaii (MERA). This connection was formalized 
in Refill, which showed that TNR, when applied to the 
Euclidean path integral of a quantum Hamiltonian i7, 
can generate a MERA for ground, excited and thermal 
states of H. Thus TNR also provides an alternative 
to previous algorithms'^ based upon variational energy 
minimization for obtaining optimized MERA, and also 
allows methods developed for extracting scale-invariant 
data from quantum critical systems using MERAi^Sci^i to 
be generalized to classical statistical systems. 

In this manuscript we introduce the numeric algo¬ 
rithms required to implement TNR for the study of 2D 
classical or ID quantum many-body systems. Due to 
the use of disentanglers, which are key to the TNR ap¬ 
proach, implementation of TNR requires more sophisti¬ 
cated optimization strategies than have been necessary in 
previous tensor RG approaches. This manuscript is orga¬ 
nized as follows. Eirst we discuss the standard techniques 
through which the partition function of a classical system 
or the Euclidean path integral of a quantum system can 
be expressed as a tensor network. Then we discuss the 
general principle of local approximations on which ten¬ 
sor RG schemes are based, before detailing the particu¬ 
lar projective truncations involved in the TNR approach. 
Optimization algorithms for the implementation of TNR 
are then presented, and their performance benchmarked 
in in the 2D classical and ID quantum Ising models. 


II. TENSOR NETWORK REPRESENTATIONS 
OF MANY-BODY SYSTEMS 


In this section we discuss approaches for which the 
partition function of a 2D classical statistical system or 
the Euclidean path integral of a ID quantum system can 
each be expressed as a square lattice network, which is 
the starting point for the TNR approach [and other ten¬ 
sor renormalization methods, such as TRG, in general]. 


A. Classical many-body systems 

Here we describe an approach for expressing the par¬ 
tition function Z at temperature T of a 2D classical sta¬ 



FIG. 1. (a) A square lattice of classical spins a G {-hi,—1}. 
(b) The partition function of the classical system can be en¬ 
coded as a square network (tilted 45° with respect to the 
spin lattice) of four-index tensors Aijki^ with a tensor sitting 
in the center of every second plaquette of spins. Here each 
tensor A encodes the Boltzmann weights of associated to the 
interactions of spins on the edges of the plaquette, see EqlSj 


tistical system. 


Z = (1) 

W) 

as a network of tensors. As a concrete example let us the 
classical Ising model on the square lattice, with Hamil¬ 
tonian functional, 

(ij) 


where G {+1,-1} is an Ising spin on site i. We 
construct a representation of the partition function as 
a square-lattice tensor network composed of copies of a 
four-index tensor Aijku where a tensor sits in the cen¬ 
ter of every second plaquette of Ising spins according to 
a checkerboard tiling, such that the square lattice of A 
tensors is tilted 45° with respect to the lattice of Ising 
spins, see also EiglU Notice that this corresponds to hav¬ 
ing one tensor A for every two spins. We define the tensor 
A to encode the four Boltzmann weights of the 

Ising spin interactions on the edges of the plaquette on 
which it sits. 


^ijki = e 


(aiaj+ajak+crkcri+aiai)/T 


(3) 


such that the partition function is then given by the sum 
over all indices. 


^ ^ ^ ^ijkl^mnoj ^krst^opqr ' ' ' • (4) 

ijk--- 

This construction for expressing the partition function 
as a tensor network can be employed for any model with 
nearest-neighbor interactions on the square-lattice, and 
can also be generalized to other lattice geometries and to 
models with longer range interactions. 
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B. Quantum many-body systems 

Here we describe how, given a local Hamiltonian H 
for a ID quantum system, an arbitrarily precise tensor 
network representation of the Euclidean time evolution 
operator can be obtained using a Suzuki-Trotter 

decomposition^. We assume, for simplicity, that Hamil¬ 
tonian is a sum of identical nearest-neighbor terms 
h, 

H = ^ ^ ( 5 ) 

r 

We begin by expanding the time evolution operator as a 
product of evolutions over some small time step r, 

= ( 6 ) 

The evolution over small time step r may then be 

approximated, 

e g '^-^odd g '^-f^even (7) 

where i^odd ^.nd i^even represent the contribution to H 
given from sites r odd or r even respectively, and an 
error of order 0(r) has been introduced. [Note that one 
can obtain an error n > 1, by using a higher 

order Suzuki-Trotter decomposition^]. Since Hodd is a 
sum of terms that act on different sites and therefore 
commute, is simply a product of two-site gates, 

and similarly for g-^^even^ 

g '^-f^odd g 'Thr,r-\-l 

odd r 

^ ^-Thr,r+l^ 

even r 

Thus, if one regards each two-site gate as a four 

index tensor and EqslS] and [7| are substituted into Eqjbl 
a representation of the Euclidean path integral as 

a square-lattice tensor network is obtained, see also Eig. 
[2](a). Note that this representation of has incurred 

an error of order 0{(3t), which can be diminished through 
use of a smaller time step r. 

While this network could potentially serve as the start¬ 
ing point for the TNR approach [or other algorithm for 
the renormalization of a tensor network] it is desirable 
to perform some preliminary manipulations before em¬ 
ploying TNR. This initial manipulation involves (i) a 
transformation that maps to a new square-lattice net¬ 
work tilted 45° with respect to the initial network, fol¬ 
lowed by (ii) coarse-graining in the Euclidean time di¬ 
rection. Given that the initial tensor network is highly 
anisotropic for small time step r, as the operator 
is very close to the identity, step (ii) is useful to obtain 
a tensor network representation of that is closer 

to being isotropic [and thus more suitable as a starting 
point for TNR]. 


Step (i) is accomplished by performing a modified step 
of the TRG algorithm as follows. The singular value 
decomposition (SVD) is taken across a vertical partition 
of the gate 

= (u^) (Vsv'^) , (9) 

where the root of the singular weights s has been ab¬ 
sorbed into each of the unitary matrices u and v, and 
likewise the eigen-decomposition is taken across a hori¬ 
zontal partition of the gate 

= (^wVd^ (^Vdw^^ , ( 10 ) 

see Eigl2][d). Here re is a unitary matrix, which follows 
from being Hermitian, and d are the eigenvalues 

[which can be argued to be strictly positive for sufficiently 
small time step r]. The SVD and eigen-decompositions 
are performed throughout the network according to the 
pattern indicated in Eigl2][a), and a new square network 
of tensors H, tilted 45° with respect to the original, is 
formed by contracting groups of the resulting tensors to¬ 
gether as indicated Eigl2][b-c). 

In step (ii) the network of tensors A is then coarse¬ 
grained in the Euclidean time direction using standard 
techniques, i.e. by combining pairs of rows together and 
then truncating the resulting squared bond index similar 
to the HOTRG^ method [see Appendix for details], 
until the network is sufficiently isotropic in terms of its 
correlations. One way to examine how close the network 
is to being isotropic is to compute the spectra of the 
transfer matrices formed by tracing out the horizontal or 
vertical indices of a single A tensor, whose decay should 
match as closely as possible. 


III. COARSE-GRAINING TENSOR 
NETWORKS 

Gonsider a tensor network Q consisting of copies of 
four index tensors Aijki that we assume are arranged in 
an 1/ X L square-lattice network with periodic bound¬ 
ary conditions. Our goal is to contract this network, or 
perhaps this network with single or multiple impurity 
tensors, to evaluate the scalar, denoted (0), associated 
to network. As an exact contraction of the network Q is 
exponentially expensive in system size L one must rely 
on approximations in order to evaluate a large network. 
In this section we first describe the generic concept of 
local approximations that could be employed to approx¬ 
imate such a contraction, then discuss the class of local 
approximation used in TRG, namely the truncated sin¬ 
gular value decomposition (SVD), before introducing the 
particular class of local approximation that the TNR al¬ 
gorithm is based on, which we call projective truncations. 
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FIG. 2. (a) The imaginary time-evolution operator is 

expressed via Suzuki-Trotter expansion as a product of two- 
site gates . Red dashed lines denote how the gates are 
to be decomposed at the next step, (b) The two-site gates 
are decomposed into a product of ternary tensors accord¬ 
ing to either a horizontal partition (accomplished via singular 
value decomposition) or a vertical partition (accomplished via 
eigen-decomposition), (c) Groups of four ternary tensors are 
contracted together to form four-index tensors A. (d) Depic¬ 
tions of the vertical and horizontal partitions of the two-site 
gates and dehnition of the four index tensors A. 




FIG. 3. (a) Depiction of [the square of] the Hilbert-Schmidt 
norm of a four index tensor u. Note that a darker shade is 
used to represent the conjugate tensor, which is also drawn 
with opposite vertical orientation, (b) Given a square lattice 
tensor network, we wish to replace a 2 x 2 block of tensors T 
from the network with a different sub-network of tensors T. 
(c) The square of the difference between T and T under the 
Hilbert-Schmidt norm is depicted, where again darker shades 
are used to depict conjugate tensors which are drawn with 
opposite vertical orientation to regular tensors. The replace¬ 
ment in (b) is valid if the difference || — ^|| is sufficiently 

small, (c) Assuming the local the square-lattice network is 
homogeneous, one can replace by in all 2 x 2 blocks. 
A coarser square-lattice network is obtained after contraction 
between pairs of three index tensors. 


A. Local approximations 


Let T denote a sub-network of tensors, for example a 
2x2 block of tensors A, from the full network Q. The 
key idea underlying coarse-graining methods for tensor 
networks is that of the local approximation: that one can 
safely replace a sub-network T with a different network 
of tensors iF if they differ by a small amount 5, 


5 = 




( 11 ) 


where we assume for convenience that iF has been nor¬ 
malized such that \\F'\\ = 1. If this condition is fulfilled, 
then the scalar {Q) associated to the contraction of net¬ 
work Q will only differ by a small amount 0{s) under 
replacement of sub-network T by new sub-network T. 
Note that we use the Hilbert Schmidt norm, 

Pll = (12) 

where TTr’ denotes the tensor trace, or equivalently the 
contraction of all indices, between two tensors of equal di¬ 
mensions [or two networks with matching ‘open’ indices], 


see also FiglSja). In general, renormalization schemes 
for tensor networks, such as TRG or the focus of this 
manuscript, TNR, employ a pattern local approximations 
over all positions on the tensor network, in conjunction 
with contractions, in order to generate coarser networks 
of tensors. For example, as illustrated in Figl3l local re¬ 
placements of all 2 X 2 blocks of tensors T with a new 
network T^ consisting of a four-index core tensor sur¬ 
rounded by three-index tensors, can result in a coarser, 
{Ll2)'x {L/2) network of new four index tensors. Assum¬ 
ing that sufficient accuracy could be maintained over re¬ 
peated steps, this procedure could be iterated 0(log2 L) 
times, resulting in a network of 0(1) linear dimension 
which could then be exactly contracted. 


B. Truncated singular value decomposition 

In principle, any form of local approximation capable 
of yielding a small error 5 in EqITT] could be viable as part 
of a coarse-graining scheme. In the original TRG algo- 
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rithm proposed by Levin and Nave^, and in many of the 
generalizations and improvements to the local 

approximations that are used are based upon a truncated 
singular value decomposition (SVD) of single tensors [or 
a generalized form of the SVD known as the higher-order 
singular value decomposition^ (HOSVD)], which we now 
discuss. 

Consider a four index tensor Aijki where each index 
is of dimension y. If the tensor is viewed as a x y^ 
matrix according to the pairing of indices then 

the SVD can be performed, 


and its conjugate, P = ww^ ^ where the isometry satis¬ 
fies w^w = I, see also FigHJ^b-c). [Note that, as part of 
the TNR algorithm, we shall also consider cases where 
projector is decomposed as a more complicated product 
of many different isometries, see for example Figl6][c)]. 
Projective truncations are a particularly useful class of 
local approximation, as the figure of merits to optimize 
projector P takes a very simple form. To see this, we 
first expand the terms in EoITTl 

^2 = ||jr|| + ||jr||-tTr(jr0^*^-tTr(jP0jr»). (17) 


Mjkl 


= E 




(13) 


where u and v are unitary according to grouping of in¬ 
dices u^ij][m\ and 'i;[m][/eZ] respectively, and s is a positive 
diagonal matrix of singular values A, i.e. Snm = 
that we assume are ordered such that Xm < A^+i. If 
we truncate the SVD to retain only the y' < y^ largest 
singular values then the decomposition becomes approx¬ 
imate. 


Notice that, as PP^ = P, for a projective truncation we 
have, 

ll^ll (18) 

It follows that the expression for the replacement error 5 
can be simplified, 

= ^J\\Tf-\\Twf, (19) 


x' 

Aijki ~ E "^ijm 

m 

where the truncation error 5 , as defined in EqJTTI is seen 
to equal to the square-root of the sum of the squares of 
the discarded singular values. 


£ = 


\ 


m=x' + l 


(15) 


Here we have assumed that the tensor A was normal¬ 
ized, ||H|| = 1, or equivalently that the singular values 
were normalized as \/J^^(Am)^ = 1 • The SVD is known 
to provide the optimally accurate decomposition of a ten¬ 
sor A into the product of a pair of tensors [connected by 
an index of some rank y'], thus it has proved vitally use¬ 
ful as the foundation for many previous schemes for the 
renormalization of tensor networks. 


C. Projective truncations 

The TNR approach requires use of a broader class of lo¬ 
cal approximation than those based upon the SVD, which 
we term projective truncations. In a projective trunca¬ 
tion, a local sub-network T is replaced by a new local 
network T that consists of a projector P, which satisfies 
ppt = p‘^ = acting on some or all of the open indices 
of P, 


P = PP = Pww^ ^ (16) 

see EiglU^a) for an example. Here we have expanded 
the projector P as the product of an isometric tensor w 


where we have again made use of PP’*' = P in reaching 
the second line of working, see also EiglU^d). 

Let us now turn to the problem of optimizing the pro¬ 
jector P such that the error 5 of EqlT9] is minimized. 
Eor simplicity we consider the case where the projector 
P decomposes as a product of a single isometry w and 
its conjugate, P = ww^ ^ although a key feature of the 
method we discuss is that it can be applied to the more 
complicated case, an in EigEfc), where P is represented 
as a product of several different isometric tensors. No¬ 
tice that the error e of EqlT9]is minimized when HPieU is 
maximized, which follows as HPieU < ||P||; we now dis¬ 
cuss an iterative strategy for optimizing isometry w to 
maximize the expression UPteH. 

The strategy we employ is based upon linearization of 
the cost function. Given that the expression ||Pre||^ has 
quadratic dependence on isometry w [or, more specifi¬ 
cally, in depends on both w and re’*'], we simplify the 
problem by temporarily holding fixed and then solv¬ 
ing the resulting linear optimization for re, and iterating 
these steps until re is sufficiently converged. Note that 
this follows the same strategy employed to optimize ten¬ 
sors in a MERA as described in Ref ill, to which we refer 
the interested reader for more details. We begin by ex¬ 
pressing the closed network ||Pre||^ in a factorized form, 

=tTr(r^0M;), (20) 

where F^t,, referred to as the environment of re, represents 
the contraction of everything in ||Pre||^ excluding tensor 
re, see also FigHJ^e-f). The singular value decomposition 
of the environment F^^, when considered as a matrix ac¬ 
cording to the same partition of indices for which tensor 
re is isomeric, is then taken, 

Tw = usv^ ^ 


( 21 ) 
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FIG. 4. (a) In a projective truncation a sub-network T is re¬ 
placed by a new sub-network T^ which consists of a projector 
P applied to the original sub-network, i.e. T — TP. (b) Here 
we assume that P is decomposed as a product of an isometric 
tensor w and its conjugate, P = . (c) By dehnition, isom¬ 

etry w contracts to identity with its conjugate, w^w = I. (d) 
The square of the error in a projective truncation is expanded 
as a sum of four terms; however given that = P, two of 
the terms cancel, see also EqUl (e) The environment of 
isometry w is dehned as the network that results by removing 
a single instance of w from ||Pie||^, see also Eal^ (f) By 
construction, the contraction of w and its environment T^^; is 
equal to ||Pie||^. (g) Environment is decomposed, via sin¬ 
gular value decomposition (SVD), into a product of isometric 
tensors u, v and diagonal matrix s. 


as shown in FigHJ^g). The isometry w is then updated to 
become, 

w = vu^ ^ (22) 

where it can be argued that this choice of updated isom¬ 
etry maximizes Eq 12Q1 However, as the cost function was 
linearized, such that in the environment F^^ was held 
fixed, these steps of (i) computing the environment F^^, 
and (ii) obtaining an updated w through the SVD of the 
environment F^^ must be iterated many times, until the 
solution converges. 


IV. TENSOR NETWORK RENORMALIZATION 

Tensor network renormalization is a class of coarse- 
graining scheme designed to be compatible with proper 
removal of all short-ranged correlations at each RG stepi. 
For any given lattice geometry there are many poten¬ 
tial TNR schemes the fulfill this requirement. In this 
manuscript we focus on a particular implementation of 



FIG. 5. The sequence of coarse-graining steps used in the bi¬ 
nary TNR scheme in order to map an initial square lattice of 
tensors A, where every second row of tensors has been conju¬ 
gated as described in Appendix El to a coarser square lattice 
composed of tensors A'. (a) A projective truncation is made 
on all 2 X 2 blocks of tensors, see Fig|6ja-c). (b) Gonjugate 
pairs of disentanglers u are contracted to identity, (c) A pro¬ 
jective truncation is made on all B tensors, see Fig[6]Jd-e). 
(d) A hnal projective truncation is made, see Figl6jf-g) for 
details, (e) Gonjugate pairs of isometries w are contracted to 
identity. 


TNR for a 2D square lattice network that we call the 
binary TNR scheme, as introduced in Refill, which re¬ 
duces the linear dimension of the network by a factor 
of 2 with each RG step. In Appendix [B] we discuss a 
ternary TNR scheme, which reduces the linear dimen¬ 
sion of the network by a factor of 3 with each RG step, 
and in Appendix [C] we discuss an isotropic binary TNR 
scheme that treats both dimensions of the tensor net¬ 
work equally while also reducing the linear dimension of 
the network by a factor of 2 at each RG step. Similarly 
TNR can also be implemented in other lattice geome¬ 
tries besides the square-lattice, including those in higher 
dimensions. The majority of the algorithmic details we 
present for implementation of the binary TNR scheme 
carry over to other TNR schemes. 

A. Coarse-graining step of the binary TNR scheme 

The starting point for an iteration of the binary TNR 
scheme is a square lattice tensor network Q composed of 
four index tensors Aijki^ where indices are assumed to 
be of some dimension %. As discussed in SectHIl such a 
network could represent the partition function of a 2D 
classical statistical system or the Euclidean path inte¬ 
gral of a ID quantum system. For simplicity we assume 
that network Q is spatially homogeneous, i.e. that all its 
tensors are copies of a unique tensor Aijku while noting 
that the algorithm can easily be extended to deal with 
non-homogeneous networks [special examples, including 
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(a) 




II 

(d) yl yi^ yR yl yl yl 

Xl Xr 

(f) 

(g) MV 

1 '’0^ 
-C?)— = -•tyR yiW 
T Vd Vy'VD 

(h) . 

Xu Xu r ~\ ——TN r 

Xw Xw Xy Xu Xu 


FIG. 6. (a) Details of the projective truncation made at the 
first step of the TNR iteration; here two copies of a projec¬ 
tor Pn, which is composed of a product isometric and unitary 
tensors, are applied to a 2 x 2 block of A tensors, (b) Defini¬ 
tion of four index tensor B. (c) Projector Pu is formed from 
isometries ul, vr and disentangler u [and their conjugates], 
(d) Details of the projective truncation made at the second 
step of the TNR iteration, (e) Definition of matrix D. (f) 
Details of the projective truncation made at the third step of 
the TNR iteration, (g) Definition of new four-index tensor 
A', copies of which comprise the coarse-grained square-lattice 
tensor network, (h) Delineation of the different dimensions 
{Xu,Xv,Xw,Xy} of indices on tensors {u,VL,VR,yL,yR,w}. 


networks with an open boundary or a defect line, can be 
handled using similar methods as those developed in the 
context of MERABS'—, and are discussed separately in 
Refld^. We also assume that Q is invariant under com¬ 
plex conjugation plus reflection on the horizontal axis, 
as discussed further in Appendix [Dl Again, this assump¬ 
tion is not strictly necessary, but is useful in simplifying 
the TNR algorithm. In the case that Q represents a Eu¬ 
clidean path integral of a quantum Hamiltonian H the 
presence of this symmetry follows from H being Hermi- 
tian, while in the case that Q represents the partition 
function of a classical system the symmetry is present if 
the underlying 2D classical statistical model has an axis 
with which it is invariant under spatial reflection. We 
now describe the coarse-graining steps involved in an it¬ 
eration of the binary TNR scheme, which maps network 
Q to the coarser network Q' whose linear dimension has 
been reduced by a factor of 2, before discussing the op¬ 
timization of the tensors involved and other algorithmic 


components in more detail. 

The first step of the iteration is to apply a particular 
gauge change on the horizontal indices on every second 
row of tensors in as discussed in Appendix [Dl Here 
the gauge change is chosen such that it is equivalent to 
flipping top-bottom indices of tensors A and taking the 
complex conjugation, as such we denote the transformed 
tensors . That such a gauge transformation exists fol¬ 
lows from the assumed reflection symmetry. Next, Eigl5] 
depicts the remaining steps in transforming network Q 
into the coarser network Q'. In Eig|5][a), a projective 
truncation is enacted on 2 x 2 blocks of tensors A [where 
two of the tensors are have undergone the aforementioned 
change of gauge as A’*'], the details of which are shown 
in Eigl6l[a). The projector Pu used at this step is rep¬ 
resented as a product of two isometries vl and vr and 
a unitary tensor u [and their conjugates] as shown in 
FigEl^c). The unitary tensors u, which we call disentan¬ 
gler act on two neighboring indices such that, if we re¬ 
gard each index of the network as hosting a x-dimensional 
complex vector space they describe a mapping be¬ 
tween vector spaces, 

u : (8) (8) (23) 

By virtue of being unitary, the disentanglers satisfy 
u^u = where I is the identity operator on V^. Con¬ 
ceptually, the role of disentanglers is to remove short- 
range correlations that would otherwise be missed, as dis¬ 
cussed in greater detail in Refill, and they constitute the 
key difference between TNR and previous tensor renor¬ 
malization schemes. Isometries vr and vr each map two 
indices in the network, one horizontal and one vertical, 
to a new index of some chosen dimension x' < 

Vl ‘ ^ (8) V^, Vr : Yy Y^ (8) V^, (24) 

where the new index has been regarded as hosting a x'- 
dimensional complex vector space V^/. By definition, 
isometries satisfy v^j^vr = with I' the iden¬ 

tity operator on V^/. After the coarse-graining step of 
FigEl^a), it is useful to define a new four index tensor H, 
which is defined from the block of A tensors and from u, 
Vr and Vr, as depicted in EiglHl^b). 

After the projective truncation implemented by pro¬ 
jector Pu is enacted on all 2 x 2 blocks of tensors, pairs 
of disentanglers from neighboring blocks can annihilate 
to identity, see EiglSKb), leaving a network of B tensors 
interspersed with groups of isometries vr and vr. Next, 
as depicted in FiglSJ^b) and further detailed in EigEl^d- 
e), a projective truncation is made on B tensors. Two 
projectors Pr and Pr are used at this step, acting on the 
left or right indices of B tensor respectively, each formed 
as a product of isometries, Pr = yRi/R and Pr = VrI/r- 
Isometries yi and yn, which satisfy y\yL = V^rUr = I', 
each map two indices to a single index also assumed to 
be of dimension x^ 

Vl • Y-^' Y^' (8) Y ^', 


Vr'.Y^^ (25) 
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FIG. 7. The linearized environments of tensors 
{vL^VR^u^yL^yR^w} involved in an iteration of the bi¬ 
nary TNR scheme, (a-c) Environments F-y^, F^;^ and Tu of 
the isometries vl, vr and disentangler u involved in the first 
projective truncation of the TNR iteration, as detailed in 
FigI3a). (d-e) Environments Fyj^ and F^^ of isometries yL 
and yR from the second projective truncation of the TNR 
iteration, as detailed in Fig[6]Jd). (f) Environment Tw of 
isometry w from the third projective truncation of the TNR 
iteration, as detailed in Eig[6]Jf). 


We then define matrix D from enacting isometries yL 
and yn on tensor 5, as shown Figlbfe). It is useful, 
though not strictly necessarily, to work in a gauge where 
matrix D is diagonal and positive, which can always be 
achieved through proper choice of gauge on isometries yL 
and yR^ such that the matrix can easily be decomposed 
as D = 

After projective truncations have been made on B ten¬ 
sors a final projective truncation, as shown Figlbfd) and 
further detailed in FigEff-g), is made using projector 
Pyj = ww^ with isometry w mapping two x-dimensional 
indices to a single index of dimension 

W I ^x' —^ ^ 

where the isometry satisfies w^w = I'. After projector 
Pw has been implemented throughout the network, pairs 
of isometries w from neighboring cells can annihilate to 
identity with their conjugates, as depicted in FigEfe). 
This final step yields a coarse-grained square lattice G' 
of four index tensors A', whose indices are of some spec¬ 
ified dimension x' < Notice that the new four-index 
tensor A' is defined from a product of various tensors ob¬ 
tained throughout the coarse-graining step, namely from 
{vl, vr, vl, Vr, VD, w}, as shown FigEtg). 


B. Optimization of tensors 

Each coarse graining iteration of the binary TNR 
scheme follows from a series of projective truncations. 
The projectors involved can be optimized using the iter¬ 
ative SVD update strategy, described in Sect Jill Cl as we 
now discuss in more detail. 

The first step of the TNR iteration, as depicted 
FigEfa), requires optimization of a projector Pu com¬ 
posed of isometries vl and vr and disentangler as 
shown FigEl^c). To update one of these tensors one first 
computes its environment, where the environments F^^, 
F^^ and F^^ are shown in FiglHa-c), then updates the 
tensor from the SVD of the environment as discussed in 
Sect illl Cl Each of the tensors vl, vr, u should be up¬ 
dated in turn and the process iterated until all tensors 
are sufficiently converged [which typically requires of or¬ 
der a few hundred iterations]. The computational cost 
of computing each of the environments scales as O(x^): 
assuming the indices involved in the network are all X" 
dimensional. 

The second projective truncation step of the TNR it¬ 
eration, as depicted FigEfc), requires the optimization of 
isometries yL and yR^ which again are optimized through 
alternating, iterative SVD updates based upon calcula¬ 
tion of their environments F^^ and F^^, as shown in 
FigI7|[d,e). Note that, in order to ensure that the reflec¬ 
tion symmetry [which was assumed to be present in the 
initial tensor network] is preserved, it is necessary to sym¬ 
metrize the environments before performing the SVD, 
as described in Appendix [0 The computational cost of 
computing each of the environments is O(x^) assuming 
the indices involved in the network are x-dimensional. 

The third and final projective truncation of the TNR 
iteration, as depicted FigEfd), requires optimization of 
isometry w which can be achieved through iterative SVD 
updates of the environment F^^, depicted in FiglTff). The 
computational cost of computing the environment F^ is 
O(x^) assuming the indices involved in the network are 
X-dimensional. 

C. RG flow of tensors 

The single iteration of the TNR approach described 
in Sect 11 V A1 which mapped the initial tensor network Q 
to the coarser network Q', can be iterated many times 
to generate a sequence of increasing coarse-grained net¬ 
works, 

g(o) ^ gW ^ ^( 2 ) ^-^ g(^) ^ . ( 27 ) 

with = g now as the initial network and network 
G^^^ as tensor network after s iterations of TNR, where 
the linear dimension of the lattice G^^^ has been reduced 
by a factor of 2 compared to the previous network • 

Each network G^^^ consists of copies of a four index tensor 
^^ijkv whose indices are of dimensions x^^\ arranged in 
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a square lattice configuration. Here the initial dimension 
is fixed from the starting tensors while the 

dimensions at later steps are user specified, and can 
be increased to improve the accuracy of the calculation at 
the cost of increasing the computational expense [aspects 
of computational efficiency will further be discussed in 
Sect JIVD] . Tensors are defined from [four copies 

of] the previous tensor under coarse-graining via a 
product of optimized isometric tensors, 








(28) 


as depicted in Figl6][g), such that we can consider TNR 
as generating an RG flow in the space of [four-index] 
tensors. 










(29) 


Properties of the system under consideration, such as the 
expectation values of local observables, can be computed 
from both the coarse-grained tensors and the ten¬ 
sors } involved in the coarse- 

graining, as further discussed in SectIVl 


D. Algorithmic details 

While the TNR algorithm discussed thus far is a viable 
implementation of approach, we now detail how this basic 
TNR algorithm can be improved in a number of ways. 

In most calculations it is convenient to use the same 
bond dimensions x^^^ foi* all RG steps s, i.e. such that 
= X for s > 0 [where x^^^ is fixed by the local di¬ 
mension of the model under consideration]. However, 
even when using the same bond dimension throughout 
different coarse-graining iterations, it can still be use¬ 
ful, in order to maximize the efficiency of the TNR ap¬ 
proach, to use different bond dimensions on vertical and 
horizontal indices of tensors , as well as different di¬ 
mensions on tensors that appear at intermediate steps of 
each coarse-graining iteration. Following this idea, four 
different refinement parameters {Xu^Xv^Xw^Xy} can be 
defined, each denoting a dimension of an outgoing index 
on different isometric tensors as indicated in FigEfh). 
Here Xw and Xy denote the dimensions of vertical and 
horizontal indices on A tensors respectively, while Xu 
and Xv denote dimensions of indices that only appear 
at intermediate steps of each TNR iteration. The ratio 
of dimensions should be adjusted such that the trunca¬ 
tion errors 5 given at different intermediate steps become 
roughly equal; in practice such dimensions can be deter¬ 
mined heuristically. For several test models it has been 
observed that the different optimal bond dimensions are, 
to good approximation, linearly related to one another 
[i.e. the ratios of different optimal bond dimensions re¬ 
main roughly constant for a given model]. This implies 
that the cost scaling of an algorithmic step can be spec¬ 
ified unambiguously, for instance as having cost O(x^): 


without detailing the dependence on the different dimen¬ 
sions involved [as they are linearly related]. Note that, 
in the benchmark results presented in Sect J VII we label 
results of a TNR simulation by a single dimension x? 
by which we mean the largest of the bond dimensions 
{XuiXv^Xw^Xy} fhat was used in the simulation. 

The computational cost of the binary TNR can be re¬ 
duced by implementing an additional projective trunca¬ 
tion on the 2x2 blocks of A tensors at the start of the 
TNR iteration, as described in Appendix [El This addi¬ 
tional step reduces the cost of computing the environ¬ 
ments F^^, F^^ and F^^, see FigI7|[a-c), from O(x^) fo 
O(x^), thus also reduces the cost of optimizing tensors 
vl^vr and u. When utilizing the ideas of Appendix |E] the 
tensor contractions required to implement TNR are all of 
cost O(x^) or less, thus the efficiency of the algorithm is 
greatly improved. 

The accuracy of TNR, for a fixed bond dimension x, 
can be improved by taking a larger environment into ac¬ 
count for optimization of the tensors, using an approach 
similar to the approach of RefsIH and 0 for improving 
standard TRG by taking the environment into consider¬ 
ation. Appendix |F] describes how the tensors involved 
in the TNR coarse-graining iteration can be optimized 
using a larger [though still local] environment, and the 
benefits of doing so. Note that, by also incorporating the 
ideas of Appendix [El the leading order computational 
cost of optimizing using the larger environments remains 
unchanged at 0(x^)- H is also possible to modify TNR 
to take account of the full environment from the network, 
similar to how SRG^ modifies the TRG to take account of 
the full environment. This modification, which we shall 
not detail in the present manuscript, requires sweeping 
the optimization back and forth over different scales of 
coarse-graining, functioning similarly to the energy min¬ 
imization algorithm for optimizing a MERA— . 


V. CALCULATION OF OBSERVABLES 

In this section we discuss how TNR can be applied to 
compute expectation values of local observables in classi¬ 
cal statistical or quantum many-body systems. There are 
many different ways of performing this calculation; one 
approach could be to construct a MERA from the TNR 
coarse-graining transformations, as described in Refill, 
from which expectation values could then be computed 
using standard MERA techniquesi^. In this manuscript 
we describe a different approach based upon directly 
coarse-graining the network with the addition of an im¬ 
purity tensor. 

Let be a homogeneous square lattice tensor net¬ 
work with periodic boundaries that consists of an L x L 
array of copies of a four index tensor A ^^^. Assume that 
the sequence of T = log2(I//2) TNR transformations 
have been optimized as to generate a sequence of coarser 
lattices, see EqEH where is a 2 x 2 lattice of tensors 
that can be exactly contacted. In order to evalu- 
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ate the expectation value of a local observable, we must 
now evaluate the tensor network with the addition 
of an impurity tensor representing the local observable 
under consideration. Here we consider an impurity ten¬ 
sor that replaces a 2 x 2 block of A tensors from 

To evaluate the impurity network we use the same 
projective truncations as was used to coarse-grain the 
homogeneous network everywhere except in the im¬ 
mediate vicinity of the impurity, the presence of which is 
incompatible with the coarse-graining steps used for the 
homogeneous system, see Fig|8l^a-e). After an iteration 
of TNR to the impurity network, one obtains a new im¬ 
purity network, equal to the homogeneous network 
except where a new impurity replaces a 2 x 2 block of 

tensors see FiglHff). The coarse-grained impurity 

is defined from applying a set of two-body gates, 
{Gr^Gl^Gu^Gy}^ to the initial impurity tensor 
as depicted in FiglSl^g), where the gates are functions 
of and the isometries {vR^VR^u^yL^yR^w} used in 
the TNR iteration, as depicted in FigEl^h). The coarse- 
graining transformation can be applied to the impurity 
network multiple times as to generate a sequence of im¬ 
purity tensors, 

M<-°) -> (30) 

each imbedded in an increasingly coarse-grained square- 
lattice network. We call the transfer operator that maps 
impurities tensors from one length-scale to the next, 
which was introduced in Refill the ascending superop¬ 
erator 7^, 

jVf (s+i) = -Ji j , (31) 

as shown in FiglHl^g). After T = log 2 (I// 2 ) RG steps, 
the impurity network only contains a single tensor 
in place of the 2x2 block of tensors that would 

otherwise have been in the homogeneous network 
from which the expectation value is evaluated through 
the appropriate trace of as depicted in FiglHl 

Note that the evaluation of two-point correlators, 
which corresponds to contracting a network with two lo¬ 
cal impurities, can be handled in a similarly. In this case 
each of the impurities will transform individually in the 
same way as EqE] until they become adjacent to one 
another in the network, where they will then fuse into a 
single impurity after the next TNR iteration. 

The evaluation of local observables can also be formu¬ 
lated in a more general way, using TNR to map the net¬ 
work on the punctured plane to an open cylinder, analo¬ 
gous to the logarithmic transformation in CFT— This 
mapping using TNR was originally formulated in RefUH, 
to which we refer the interested reader for more details. 
A brief summary is included here for completeness. In 
Fig lTOl a) we consider a finite square lattice network that 
has a 2 X 2 block of tensors removed, such that the in¬ 
dices connecting to the block are left open. As with 
the case of the impurity network considered previously, 
one can coarse-grain this network with TNR, performing 



FIG. 8. (a-e) An iteration of the TNR coarse-graining trans¬ 
formation for a square-lattice tensor network that is homo¬ 
geneous everywhere except for a 2 x 2 region that has been 
replaced with an impurity tensor . The projective trun¬ 
cations of the TNR iteration are applied as usual, see FigO 
neglecting those which are incompatible impurity tensor, (f) 
The coarse-grained square lattice is homogeneous everywhere 
except for a 2 X 2 region occupied by new impurity tensor 
(g) The coarse-grained impurity tensor is given 

by enacting ascending superoperator IZ^ defined from two 
body gates {Gr^Gl^Gu^Gy}^ on the impurity tensor 
(h) Definition of two body gates {Gr^ Gl, Gu^ Gy}- 



FIG. 9. A finite network with periodic boundaries and a local 
impurity is coarse-grained into a single impurity tensor 

j^(s+i) under the transformation depicted in Fig|8l The ex¬ 
pectation value of the local observable corresponding to the 
impurity is given from the trace of as depicted. 


the same projective truncations except in the immedi¬ 
ate vicinity of the open indices, which must remain un¬ 
touched. The result of this is shown in FiglTOla-db the 
square lattice network [with an open ‘hole’] is mapped 
to a tensor network on a finite width cylinder. Here one 
end of the cylinder has free indices, which correspond to 
those of the open ‘hole’, and moving along the length 
of the cylinder corresponds to a change of scale in the 
original system, where each double row of tensors in the 
cylinder corresponds to an application of the ascending 
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superoperator IZ as defined in FiglSfg). 

Using the same transformations, the tensor network 
with local impurity, as depicted in Fig lTOf e). is mapped 
to a closed cylindrical network after coarse-graining with 
TNR, as depicted in Fig lTOf fh Contracting this network 
from bottom-to-top it would be equivalent to evaluating 
the expectation value by coarse-graining the observable 
as discussed previously, see EqjSOl However, one could 
also evaluate the observable by contracting the network 
contracting from top-to-bottom, or in some other de¬ 
sired order. In practice, exact contraction of the network 
shown in FiglTOlf) is computationally expensive for large 
bond dimension y, thus it may be necessary to use an 
approximate method for this evaluation. The approx¬ 
imate method we employ in this manuscript is based 
upon contracting the network layer by layer from top- 
to-bottom, where we approximate the boundary state as 
a matrix product state^li^ (MPS) and use the TEBD 
algorith m^^i^^ to apply each layer of gates from cylinder 
while maintaining an MPS representation. 


VI. BENCHMARK RESULTS 
A. 2D classical Ising model 

In this section we provide benchmark calculations for 
the binary TNR algorithm, comparing against TRG, for 
the partition function of 2D classical Ising model, as de¬ 
fined in Eqs(T]and[2l We begin by encoding the partition 
function as a tensor network as discussed in Sect JII Al a 
four index tensor Aijki is used to encode the four Boltz¬ 
mann weights on the edge of a plaquette, as per Eql3l 
which corresponds to having one tensor A for every two 
spins and a tensor network with a 45 degree tilt with re¬ 
spect to the spin lattice, see Eig. [TJa-b). Eor convenience 
we then contract a 4 x 4 square of tensors A to form a 
new tensor of bond dimension y = 16, which serves 
as the starting point for the both the TNR and TRG 
approaches. We apply up to 20 RG steps of either TNR 
or TRG, which corresponds to lattices of Ising spins with 
linear dimension up to L = 4 x 4 X 10^ spins. Here 

we define an RG step as that which maps the square lat¬ 
tice to a new square lattice of the same orientation, but 
of half the linear dimension; note that this corresponds 
to two steps of TRG as defined in RefU. Each of the ap¬ 
proaches generates a sequence of coarse grained tensors, 
as per Eqisa where copies of tensor comprise the 
coarse-grained network after s RG steps. 

In the implementation of TNR we enforce reflection 
symmetry, as discussed in Appendix [D1 on both spatial 
axes, and also employ the ideas discussed in Appendix [E] 
to reduce the leading order cost of the TNR algorithm 
from scaling as O(y^) to scaling as O(y^) in terms of the 
bond dimension y. Eurt her more we optimize tensors us¬ 
ing the larger environment as discussed in Appendix [F1 
and also use Z 2 invariant tensors [recall that the Ising 
model has a global Z 2 symmetry: it is invariant under 



FIG. 10. (a) An 8x8 square lattice of tensors that has had 
a 2 X 2 block of tensors removed, leaving 8 open indices, (b) 
The lattice after one iteration of coarse-graining with TNR. 
(c) The lattice after a second iteration of coarse-graining with 
TNR. (d) The network from (c) is redrawn on the cylinder. 
Each double layer of the network corresponds to the ascending 
superoperator IZ as defined in Fig|8][g). (e) An 8x8 square 
lattice of tensors with an impurity a positioned on a link, (f) 
The network from (e) after two iterations of coarse-graining 
with TNR. 


the simultaneous flip ak —(Jk of all the spins], which 
are employed using standard methods for incorporating 
global symmetries in tensor networks^. The TRG results 
have been calculated using the square-lattice TRG algo¬ 
rithm as presented in RefQ, the cost of which also scales 
as O(y^) in terms of the bond dimension y. While the 
cost of TRG and TNR both scale as O(y^), the overall 
cost of a TNR calculation is greater than a TRG calcu¬ 
lation of the same bond dimension by a constant factor, 
k ~ 200, stemming from the iterative nature of the TNR 
optimization. 

Fig- niTa]) explores the truncation error 5 , as defined 
in EqJTTI incurred in RG step s of the either the TRG 
or TNR approach applied to the Ising model at critical 
temperature, Tc = 2/log(l + v^) 2.269. It is seen 

that, although increasing the bond dimension y of TRG 
reduces the initial truncation error 5 , the error always 
increases quickly as a function of RG step s regardless 
of the bond dimension in use, a phenomenon described 
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FIG. 11. (a) Comparison between TRG and TNR of the trun¬ 
cation error e, as defined in Ea llll as a function of RG step 
s in the 2D classical Ising model at critical temperature Tc. 
While increasing the bond dimension x gives smaller trunca¬ 
tion errors, the truncation errors still grow quickly as a func¬ 
tion of RG step s under TRG. Conversely, truncation errors 
remain stable under coarse-graining with TNR. (b) Relative 
error in the free energy per site 6f at the critical temper¬ 
ature Tc, comparing TRG and TNR over a range of bond 
dimensions y. The error from TRG is seen to diminish poly- 
nomially with bond dimension, with fit Sf oc (where 

the inset displays the same TRG data with logarithmic scales 
on both axes), while the error from TNR diminishes expo¬ 
nentially with bond dimension, with fit Sf oc exp(—0.305x)- 
Extrapolation suggests that TRG would need bond dimension 
X ~ 750 to match the accuracy of the x = 42 TNR result. 


as the break-down of TRG at criticality in the original 
work by Levin and Nave^. In comparison it is seen that 
TNR avoids such a break-down; the truncation errors 
e remain constant over many RG steps s when coarse- 
graining with TNR, beyond a slight increase after the 
initial RG step. 

The relative error in the free energy per site, / = 
—T\og{Z)/N, at the critical temperature Tc is compared 
for TRG and TNR over a range of bond dimensions x 
in FiglTTJb). Evident is a qualitative difference in the 
convergence of the free energy between the approaches. 
In TRG the free energy / is seen to converge polyno- 
mially with x? with fit Sf oc while in TNR / 

is seen to converge exponentially fast with x? with fit 
Sf oc exp(—0.305x)- Given that the cost of implement¬ 
ing the two approaches differs only by a constant fac¬ 
tor, k ^ 200, for equivalent bond dimension x, it is evi¬ 
dent that TNR can produce a significantly more accurate 
free energy than would be computationally viable with 
standard TRG. For instance, extrapolation suggests that 
in order to match the accuracy in the free energy for 
X = 42 TNR, which required approximately 12 hours 
computation time on a laptop computer, one would need 
to implement TRG with x ~ 750, far beyond what is 
considered feasible with the approach. Figure [12] shows 



FIG. 12. (a) Spontaneous magnetization M(T) of the 2D 

classical Ising model near critical temperature Tc, both exact 
and obtained with TNR with x = 6. Even very close to 
the critical temperature, T = 0.9994 Tc, the magnetization 
M ^ 0.48 is reproduced to within 1% accuracy, (b) Specific 
heat, c(T) = —T^^, both exact and obtained using TNR 
with X — 


the spontaneous magnetization M(T) and specific heat 
c(T) = —tJ^ obtained with TNR for X = 6, over a 
range of temperatures T near the critical temperature Tc. 
Remarkable agreement with the exact results is achieved 
throughout, even very close to the critical point Tc. 

Next we explore ability of TNR to produce a scale- 
invariant RG flow in the space of tensors for the 
Ising model at critical temperature Tc. We apply up 
to 20 RG steps of TNR to the partition function, em¬ 
ploying the gauge fixing strategy discussed in Appendix 
o from the third RG step onwards. The difference 
= IIII between tensors at successive 
RG steps [where tensors have been normalized such that 
pW|| = l] is displayed in FigIT3l For the larger x cal¬ 
culations, the difference reduces after the initial RG 
steps, before increasing again in the limit of many RG 
steps. This behavior is to be expected. The main limita¬ 
tion to realizing scale-invariance exactly in the initial RG 
steps is physical: the lattice system includes RG irrele¬ 
vant terms that break scale-invariance at short-distance 
scales, but are suppressed at larger distances. On the 
other hand, after many RG steps the main obstruction to 
scale invariance is the numerical truncation errors, which 
can be thought of as introducing RG relevant terms, ef¬ 
fectively shifting the flow away from criticality and thus 
away from scale invariance. However, use of a larger bond 
dimension x reduces truncation errors, allowing TNR to 
not only achieve a more precise approximation to scale- 
invariance, but also to hold it for more RG steps. 

In order to demonstrate that the [approximate] fixed 
point map given by TNR is representative of the 2D 
Ising universality class we extract the critical data from 
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FIG. 13. The precision with which TNR approximates a 
scale-invariant fixed point tensor for the 2D classical Ising 
model at critical temperature Tc is examined by compar¬ 
ing the difference between tensors produced by successive 
TNR iterations 5^^^ = where tensors have 

been normalized such that = 1. The precision with 

which scale-invariance is approximated in the initial RG steps 
[small s] is limited by the presence of RG irrelevant terms in 
the lattice Hamiltonian that break scale-invariance at short- 
distance scales, while numerical truncation errors, which can 
be thought of as introducing RG relevant terms, shift the sys¬ 
tem from criticality [and thus scale invariance] in the limit of 
many RG steps s. 


this map. This calculation was previously carried out in 
Refllbl. to which we refer the interested reader for more 
details. Scaling operators, with their corresponding scal¬ 
ing dimensions, are obtained from diagonalization of the 
ascending superoperator 7^, see FigEl^a), associated to 
the 5 = 4 coarse-graining iteration with TNR. At this 
level of coarse-graining the RG irrelevant terms in the 
system have been sufficiently suppressed, such that a 
good approximation to scale-invariance is realized. The 
smallest 101 scaling dimensions obtained from a x = 6 
TNR calculation are displayed in FigJTffi all of which are 
within 2% of their exact values. Also computed were 
the operator product expansion (OPE) coefficient o^^i^^ 
for the primary fields, see again Refill for details, which 
were found to match their correct values from CFT to 
within 0.2%. These results indeed confirm that the fixed 
point RG map given by TNR is accurately characterizing 
the Ising CFT. 


B. ID quantum Ising model 


In this section we provide benchmark calculations for 
the binary TNR algorithm applied to the Euclidean path 
integral of the ID quantum Ising model, which has 
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FIG. 14. The smallest 101 scaling dimensions of the 2D classi¬ 
cal Ising at critical temperature Tc, obtained by diagonalizing 
the ascending superoperator IZ, see FiglSUg), using TNR with 
bond dimension x = 6. The scaling dimensions are organized 
according to the parity p = ±1 (even/odd) and locality of 
the corresponding scaling operators. All scaling dimensions 
shown are reproduced to within 2% of their exact values. 


Hamiltonian i^is. defined, 

J^is. (32) 

k 

where and are Pauli matrices, and A represents 
the magnetic field strength. For convenience we perform 
an initial blocking step, in which blocks of four spins 
are combined into effective sites of local dimension d = 
16, and then generate the tensor network representation 
of the Euclidean path integral as explain in Sect JIIBl 
We typically use a time step of r = 0.002 and coarse- 
grain in the Euclidean time direction using 10 iterations 
of the single dimension coarse-graining scheme explained 
in Appendix El before beginning the TNR calculation. 

To start with, we compare the performance of the 
TNR algorithm as a means to optimize a MERA— ver¬ 
sus the energy minimization approach of Refill. The 
ground state of the Ising Hamiltonian i^is. at critical 
magnetic field strength, A = 1, is represented using a 
scale-invariant MER A^^i^^~ — , here consisting of three 
transitional layers followed by infinitely many copies of a 
scale-invariant layer, obtained in two different ways. In 
the first approach, we apply four coarse-graining itera¬ 
tions of TNR to the Euclidean path integral of His ,, after 
which the flow in the space of tensors has reached an ap¬ 
proximate scale-invariant fixed-point. A scale-invariant 
MERA is then built from certain tensors that were pro¬ 
duced from the TNR calculation, specifically the disen- 
tanglers u and isometries re, as described in the Refill. 
Here the first three iterations of TNR generate the three 
transitional layers, while the fourth iteration of TNR 
is used to build the scale-invariant layer. In the sec¬ 
ond approach, we use the energy minimization algorithm 
of Refs Hoi and [H to directly optimize a scale-invariant 
MERA [with three transitional layers preceding the scale- 
invariant layers] by iteratively minimizing the expecta¬ 
tion value of the H. Presented in Eig. [Tbf ai is the com¬ 
parison between the ground energy error 6E obtained by 
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the two methods. For an equivalent bond dimension x, 
energy minimization produces a MERA with smaller er¬ 
ror 5E than TNR, by a factor k ^ 10 that is roughly 
independent of y. However, optimization using TNR 
is also computationally cheaper than optimization us¬ 
ing the energy minimization algorithm; the cost of TNR 
scales as O(x^) in terms of bond dimension y, while the 
energy minimization scales as O(x^). In addition, the 
energy minimization algorithm, which iteratively sweeps 
over all MERA layers, requires more iterations to con¬ 
verge than does TNR. Taking these considerations into 
account, TNR can be seen to be the more efficient ap¬ 
proach to obtain a ground state MERA to within a given 
level of accuracy in the energy SE^ see Refill for ad¬ 
ditional details. Thus the TNR approach represents a 
useful, alternative means for optimizing a MERA and, 
by extension, is promising as a tool for the exploration 
of ground states of quantum systems. 

In EigHn^b) the low energy excitation spectra of i^is. 
at criticality, A = 1, is plotted as a function of system 
size L. This was computed using TNR to coarse-grain 
the Hamiltonian i^is., as explained in Refill, which was 
then diagonalized on a finite lattice with periodic bound¬ 
aries. The excitation spectra reproduce the expected 1/L 
scaling with system size and match the predictions from 
GET— demonstrating that, in addition to the ground 
state, TNR can accurately approximate the low-energy 
eigenstates of His,. 

Next we explore the use of TNR for computing expec¬ 
tation values of finite temperature thermal states. This 
is achieved by applying TNR to the tensor network cor¬ 
responding to for inverse temperature /3, as dis¬ 

cussed in Sect JH Bl which is then used to generate a ther¬ 
mal state MERA as explained in Refill. The thermal en¬ 
ergy per site as a function of /3 is displayed in EigJIblai 
for several different magnetic field strengths A. In the 
gapped regime, A > 1, the thermal energy converges ex¬ 
ponentially quickly to the ground energy in the limit of 
large /3 [or small temperature T], while at the gapless 
critical point, A = 1, the thermal energy converges poly- 
nomially quickly to the ground energy with /3. The re¬ 
sults from X = 12 TNR accurately reproduce the exact 
energies over the range of parameters considered. Two- 
point correlation functions of the critical, A = 1, system 
are examined in Eig lTbl bi over a range of inverse temper¬ 
atures yd, where correlations are seen to decay faster at 
smaller p [or equivalently at higher temperature T] due 
to thermal fluctuations. Again, the results from x = 12 
TNR accurately reproduce the exact correlations, indi¬ 
cating that TNR can be used to approximate thermal 
states of quantum systems over a wide range of temper¬ 
atures. 


VII. DISCUSSION 


After reviewing the conceptual foundations for real- 
space renormalization of partition functions and Eu¬ 
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FIG. 15. (a) Relative error in the energy of scale-invariant 
MERA optimized for the ground state of the ID quantum 
Ising model at criticality in terms of bond dimension x? com¬ 
paring MERA optimized using TNR to those optimized us¬ 
ing variational energy minimization. Energy minimization 
produces MERA with a more accurate approximation to the 
ground energy, but is significantly more computationally ex¬ 
pensive [with a computational cost that scales as O(x^) ver¬ 
sus as O(x^) for TNR]. (b) Low energy eigenvalues of the 
ID quantum Ising model at criticality as a function of 1/L, 
computed with x = 12 TNR. Discontinuous lines correspond 
to the finite-size CFT prediction, which ignores corrections of 
order L~^. 



Inverse temperature, (3 Distance, d 


FIG. 16. (a) Thermal energy per site (above the ground state 
energy) as a function of the inverse temperature yd, for the ID 
quantum Ising model in an infinite chain, for different values 
of magnetic field A. Data points are computed with x = 12 
TNR while continuous lines correspond to the exact solution, 
(b) Gonnected two-point correlators at the critical magnetic 
field A = 1, as a function of the distance d, for several values 
of l3. Data points are computed with x = 12 TNR while 
continuous lines again correspond to the exact solution. 


clidean path integrals, when expressed as tensor net- 







































15 


works, a self-contained description of the algorithm for 
employing TNR to study properties of classical and quan¬ 
tum many-body systems was provided. 

Benchmark results, provided in Sect JVIi demonstrated 
some of the advantages of TNR. These include (i) provid¬ 
ing a computationally sustainably coarse-graining trans¬ 
formation even for systems at or near critical point [i.e. 
one that can be iterated many times without increase in 
truncation error], (ii) convergence in the RG flow of ten¬ 
sors to a scale-invariant fixed point for a critical system 
[which then allows calculation of the critical data from 
the fixed point RG map directly], (hi) providing an al¬ 
ternate, more efficient means for optimizing a MERA for 
the ground state of a quantum system, and (iv) providing 
a means to accurately study properties of thermal states 
of quantum systems over a wide range of temperatures 
T. With regards to (i) above, TNR was demonstrated 
to overcome a major obstacle of previous schemes for 
renormalization of tensor networks, such as TRG, which 
exhibit a computational breakdown when near or at a 
critical point. As a consequence, the free energy per site 
/ of the 2D classical Ising model at criticality was seen to 
converge to the exact value exponentially faster in bond 
dimension y with TNR than with the previous TRG ap¬ 
proach. 

Future work shall include the development and imple¬ 
mentation of TNR schemes for the coarse-graining of net¬ 
works on ‘^D lattices, which could be applied to study ‘^D 
classical statistical and 2D quantum many-body systems. 
A TNR scheme for 3T) lattices would offer an alternative, 
potentially more efficient, means to optimize a 2D MERA 
over the previous [often prohibitively expensive] strate¬ 
gies based upon energy minimizatio n^^dQ . The TNR ap¬ 
proach presented in this manuscript can also be used to 
compute the norm (T|T) of a 2D quantum many-body 
state encoded in a PEPS^i^, thus it could be incorpo¬ 
rated as a key part of an algorithm for simulation of 2D 
quantum many-body systems using PEPS^. 

The author thanks Markus Hauru and Guifre Vidal for 
insightful comments. The author acknowledges support 
by the Sherman-Fairchild Foundation and by the Simons 
Foundation (Many Electron Gollaboration). 


Appendix A: Coarse-graining along a single 
dimension 

In this appendix we describe a scheme that coarse- 
grains a square-lattice along one dimension only, which 
is similar in effect to the higher order tensor renormal¬ 
ization group (HOTRG) method introduced in RefU. It 
is useful to perform this coarse-graining to rescale one 
dimension before applying the TNR algorithm if the ini¬ 
tial tensor network is highly anisotropic in the strength of 
its correlations [which occurs, for instance, when the net¬ 
work represents the Euclidean path integral of a quantum 
system expanded with a very small time-step r]. The pre¬ 
liminary coarse-graining can generate a network that is 



FIG. 17. An iteration of a coarse-graining scheme that acts 
to compress only the vertical dimension of the square-lattice 
tensor network, (a) A projective truncation, involving isome¬ 
tries is employed, (b) Details of the projective truncation 
from (a); here a projector P, comprised of an isometry w and 
its conjugate, is applied to a pair of A tensors, (c) The coarse¬ 
grained network, comprised of tensors A' is given via tensor 
contractions, (d) Definition of the coarse-grained tensor A'. 


more isotropic in the strength of its correlations and thus 
more suitable as a starting point for the TNR approach, 
which then rescales both lattice dimensions equally. 

An iteration of the coarse-graining, which acts to com¬ 
press the vertical dimension of the square-lattice tensor 
network by a factor of two, is depicted in FigJTTl The first 
step, as shown FigHTJa), involves a projective truncation 
that acts upon a pair of A tensors, as further detailed in 
Fig lTTI b). The isometries w that comprise the projec¬ 
tor can be optimized in the standard way, as discussed 
in Sect Jill Cl The second step, as shown in Fig lTTI cb in¬ 
volves contraction of a pair of A tensors with isometries 
re, as detailed in FiglTTIdb to generate the tensors A' of 
the coarse-grained network. 

Appendix B: Ternary TNR scheme 

The binary TNR scheme presented in Sect ilV Al is one 
of many possible TNR schemes for the square-lattice; 
here we describe a ternary TNR scheme which reduces 
the linear dimension of the lattice by a factor of 3 with 
each iteration [or, equivalently, coarse-grains a 3 x 3 block 
of tensors into a new tensor with each iteration]. One 
advantage of the ternary TNR scheme is that single ten¬ 
sor impurities can remain single tensor impurities under 
coarse-graining, in contrast to the binary TNR scheme in 
which impurities spread to 2 x 2 blocks as depicted FiglHl 
This property could be convenient for certain types of 
calculation, such as in the evaluation of conformal data 
from a critical system. Through a similar derivation as 
presented in RefUsl. where the binary TNR scheme was 
shown to yield a binary MERA, the ternary TNR scheme 
can be shown to yield a ternary MERAi^. 

The steps of an iteration of the ternary TNR scheme 
are shown in FigJTSla-ej. These steps are as follows: (a) 
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FIG. 18. A depicted of an iteration of the ternary TNR 
scheme, which maps a square-lattice tensor network to a 
coarse-grained square-lattice of one-third the linear dimen¬ 
sion of the original, (a) A projective truncation, detailed in 
FigUnja). (b) Pairs of disentanglers u annihilate to iden¬ 
tity. (c) A projective truncation, detailed in Fig lTOl bj. (d) 
A projective truncation, detailed in Fig fT^ cb (e) Pairs of 
isometries w annihilate to identity, yielding the coarse-grained 
square lattice network. 


a projective truncation involving isometries vl^ vr and 
disentangler u as detailed in FigITCTa). (b) annihilation 
of conjugate pairs of disentanglers u to identity, (c) a 
projective truncation involving isometries hr and hr as 
detailed in FiglTOlb). (d) a projective truncation involv¬ 
ing isometry w as detailed in FiglT^c). (e) annihilation 
of conjugate pairs of the isometry w to identity. The four- 
index tensor A' of the coarse-grained network, as defined 
in Fig lT^ c). now accounts for a 3 x 3 block of tensors A 
from the original square-lattice network. 


Appendix C: Isotropic TNR scheme 

In this appendix we present another TNR scheme for 
the square-lattice. Like the binary TNR scheme pre¬ 
sented in the main text, this scheme also reduces the 
linear dimension of the lattice by a factor of 2 with each 
iteration. However, unlike the binary TNR scheme, this 
scheme treats both dimensions of the lattice equally, for 
which we refer to it as the isotropic TNR scheme. Thus, 
if the starting network that is invariant under 90° rota¬ 
tions, such as that corresponding to the partition func¬ 
tion of an isotropic 2D classical statistical model, this 
TNR scheme can preserve the rotational symmetry un¬ 
der coarse-graining. 

The isotropic TNR scheme is applied to a square- 
lattice network with a four-site unit cell, where it is as¬ 
sumed that the network consists of three types of four 
index tensor, Ap and As shown in Figl 20 ]the lat¬ 
tice has a 2 X 2 unit cell where each A^ tensor connects 
with four Ap tensors in the network, and likewise each 



FIG. 19. Overview of the projective truncations involved in 
the ternary TNR scheme, (a) A projective truncation, imple¬ 
mented by projector composed of isometries i’l, vr and 
disentangler acts upon a 3 x 2 block of A tensors, (b) A pro¬ 
jective truncation, formed from isometries i/l, Vr and their 
conjugates, acts upon B tensors, (c) A projective truncation, 
formed from isometry w and its conjugate, acts to give the 
new four index tensor A' of the coarse-grained network. 


Ar tensor also connects with four Ap. It is assumed that 
Ap and A^ tensors are invariant with respect to 90° rota¬ 
tions, while Ap tensors are invariant with respect to 180° 
rotations; under this assumption the square-network it¬ 
self is invariant with respect to 90° rotations centered 
about either an Ap or Ar tensor. Notice that a uni¬ 
form [one-site unit cell] square lattice is just a special 
case of this four-site unit cell lattice, where indices on 
one of the sub-lattices, such as indices connected to Ar 
tensors, are fixed at trivial dimension, i.e. bond dimen¬ 
sion X = 1. Thus this isotropic TNR scheme can be 
directly applied to the partition function of an isotropic 
2D classical statistical model, when it is represented as 
a uniform square-lattice network of tensors A that are 
invariant with respect to 90° rotations. 

The steps of a coarse-graining iteration of the isotropic 
TNR scheme are shown in Fig |2Qlf a-dL The initial step, 
shown in Fig i2Qlf aL involves two different projective trun¬ 
cations. One of the projective truncations, as detailed in 
FigEHa), acts upon a block of four Ap tensors and a 
A 5 tensor, while the other acts upon individual Ar ten¬ 
sors as detailed in FigElfb). In the second step of the 
iteration, shown in Fig l2Ql b). conjugate pairs of disen¬ 
tanglers u annihilate to the identity. A pair of projective 
truncations are used in the third step of the iteration, 
seen in Fig i2Qlf cL These projective truncations, which 
involve a projector composed of an isometry w and its 
conjugate, are detailed in Figl 2 T][c-d). In the final step 
of the iteration, as shown in Fig | 2 Qr dL certain isometries 
w annihilate to identity with their conjugates, yielding 
the coarse-grained network. Notice that the tensors A^', 
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FIG. 20. Depiction of a single iteration of the isotropic TNR 
scheme, which maps a square-lattice network, comprised of 
tensors Ap and Ar, to a coarser lattice of the same type, 
(a) Two types of projective truncation are made, as detailed in 
Fig |2TT a-bj. (b) Conjugate pairs of disentanglers u annihilate 
to identity, (c) Two types of projective truncation are made, 
as detailed in Fig[2T][c-d). (d) Conjugate pairs of isometries 
w annihilate to identity, yielding a coarse-grained network 
comprised of tensors A'b, A'p and A'r- 


Ap and Ap of the coarse grained network, as defined 
in Figl2Tl possess the same rotational symmetry as the 
corresponding initial tensors Ap and Ap^ and also 
that the coarse-grained network has the same unit cell 
[in terms of the coarse-grained tensors] as the initial net¬ 
work, but is reduced by a factor of 2 in linear dimension. 


Appendix D: Reflection symmetry 

In this appendix we describe the details, given a ten¬ 
sor network Q that is symmetric with respect to spatial 
reflections [perhaps in conjunction with complex conju- 



FIG. 21. Overview of the projective truncations involved in 
an iteration of the isotropic TNR scheme, (a) A projective 
truncation, involving isometries v and disentanglers is en¬ 
acted upon a product of four Ap tensors and a Ah tensor. 
The coarse-grained tensor A'h is also dehned. (b) A projec¬ 
tive truncation, involving isometries y and disentanglers is 
enacted upon Ap tensors, (c) A projective truncation, involv¬ 
ing isometries w, is enacted, yielding coarse-grained tensors 
A'p. (d) A hnal projective truncation, again involving isome¬ 
tries w, is applied to a product of At and v tensors, yielding 
coarse-grained tensors A'p. 


gat ion] along one axis, for how the symmetry can be pre¬ 
served under coarse-graining with TNR. In the case that 
Q represents a Euclidean path integral the presence of 
this symmetry follows from the Hermicity of the Hamilto¬ 
nian, and is thus always present, while in the case that G 
represents a partition function the symmetry is present if 
the underlying 2D classical statistical model is invariant 
under spatial reflection along an axis. Proper exploita¬ 
tion of this symmetry is desirable as it can significantly 
simplify the TNR algorithm. 

We say the homogeneous tensor network Q is Hermi- 
tian symmetric with respect to the horizontal axis if a 
row of tensors, which form a matrix product operator 
(MPO), is invariant with respect to permutation of top- 
bottom indices in conjunction with complex conjugation, 
see also Figl22l If a row of tensors satisfies the above def¬ 
inition of reflection symmetry, then it can be shown that 
permutation of top-bottom indices and complex conjuga- 
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tion of tensor A is equivalent to enacting a unitary gauge 
change on its horizontal indices, 

= {AiikjT = (Dl) 

j',i' 

see also Figl22fb-c). Here the indices of tensor Aijki are 
labeled clockwise from the top, as per Fig(T]^a), and x is 
some unitary matrix. 

In the first step of the TNR iteration, as discussed in 
Sect llV Al it is useful to enact the unitary gauge change 
X on every second row of tensors in the network Q as de¬ 
picted in FigISfb). Let us define tensor Q as the tensor 
formed from contracting two copies of A and two copies of 
together as depicted in FigEfd). The reason that the 
initial gauge transformation on Q is useful is that it allows 
tensor Q to be Hermitian under exchange of top-bottom 
indices, thus at the first step of the TNR iteration the 
same projector Pu may be used both on the top and bot¬ 
tom of Q, see Figl6fa-c). The reflection symmetry can be 
preserved under the TNR iteration, such that the tensors 
A of the coarse grained network satisfy Enirm for some 
unitary matrix x', if the isometries i/l and i/r used in 
the second step of the TNR iteration satisfy the relation 
shown in Figl22je-f). This relation states that the isome¬ 
tries should be invariant under complex conjugation in 
conjunction with permutation of their incoming indices 
and a unitary gauge change, enacted by unitary matrix 
x', on their outgoing index. Isometries yL and yR satis¬ 
fying this relation can be obtained by symmetrizing the 
environments Ty^ and F^^ of the isometries during their 
optimization, similar to previously strategies for preserv¬ 
ing reflection symmetry in MERA described in Refl^. 

Finally, we remark these ideas can be extended such 
that reflection symmetry along the vertical axis can be 
preserved [simultaneously with that on the horizontal 
axis], if both symmetries are present in the initial net¬ 
work. 


Appendix E: Reduction of computational cost 

The cost of the TNR algorithm as described in SectUVl 
scales as O(x^) in terms of the bond dimension y; in this 
appendix here we describe how this cost scaling can be 
reduced to O(x^). This reduction in cost is achieved by 
doing an additional projection truncation at the start of 
each TNR iteration; specifically this projective trunca¬ 
tion is enacted on 2 x 2 blocks of A tensors, with two 
of the tensors conjugated as discussed in Appendix [Dl 
before the projective truncation step of Figl6l[a-c). The 
projector P involved in this step is composed of isome¬ 
tries qi^ Qr and 2 : [and their complex conjugates], as de¬ 
picted in FiglSSl and can be optimized with the standard 
iterative SVD approach as described in Sect Jill Cl 

After this initial projective truncation the cost of 
the subsequent step of the TNR iteration is reduced. 
FiglH^c) depicts the new tensor H, which differs from 



FIG. 22. (a) The tensor A is Hermitian symmetric if a row of 
such tensors is invariant with respect to permutation of top- 
bottom indices in conjunction with complex conjugation, (b) 
Permutation and complex conjugation of Hermitian symmet¬ 
ric A is equivalent to a gauge change, enacted by some unitary 
matrix x, on its horizontal indices, (c) Definition of AL (d) 
A gauge change is performed on the tensors of every second 
row of the square-lattice network, (e) Definition of tensor Q. 
(f) Tensor Q is seen to be Hermitian. (g-h) Constraints for 
isometries yL and yn necessary such that the tensors of the 
coarse-grained network remain Hermitian symmetric. 


the tensor B in FigEl^b) only by an amount related to the 
truncation error 5 of the initial projection step, but can 
be computed with a cost that scales 0{x^), as opposed 
to O(x^) foi* computing B. Likewise the environment 
F^ of disentangler u when expressed in terms of 5, see 
Figl23rdj. can also be computed with cost O(x^) instead 
of the cost O(x^) associated to computing the previous 
environment of FigI7|[c). Similarly, the environments of 
isometries vr and vr can also be computed with cost 
O(x^) when using B. Thus, when using the results of 
this appendix, no operation required to implement the 
binary TNR scheme has a cost scaling of greater than 
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FIG. 23. (a) Details of an optional, preliminary projective 
truncation for the binary TNR scheme where two copies of a 
projector P, which is formed from a product isometric tensors 
qR^ z and their conjugates, are enacted upon a 2 x 2 block 
of A tensors, (b) Definition of tensor K. (c) Definition of 
tensor P, which differs from the previous P, see Fig|6jb), 
only by an amount related to the truncation error of P in 
(a), (d) Detail of the environment F^ computed from P. The 
cost of contracting this network sales as O(x^) in terms of 
the bond dimension y, as opposed to O(x^) for the previous 
environment of FiglTlJc). 


Appendix F: Optimization using a larger 
environment 

In this appendix we discuss how the accuracy of the 
binary TNR scheme, for given bond dimension x, can 
be improved by taking a larger environment into account 
at each truncation step. This follows similar ideas in¬ 
troduced in Ref0 to improve TRG by taking the local 
environment into consideration at each truncation step. 

The TNR approach is based upon the use projec¬ 
tive truncations to implement coarse-graining transfor¬ 
mations, as discussed in Sect Jill Cl A projective trunca¬ 
tion involves application of a projector P to a local sub¬ 
network of tensors P*, where it is desired that P acts on T 
as an approximate resolution of the identity, see EqUHl 
Use of a larger sub-network T typically allows a more 
accurate truncation, as the projector P can take into ac¬ 
count correlations from a larger region of the network. 
Fig lMIf aj depicts a larger sub-network, consisting of two 
copies of the B tensor in addition to vl and vr tensors, 
that can be used in the determination of the projectors 
Pl, Pr and in the second and third step of the TNR 
iteration. The condition that projectors Pl, Pr and P^ 
act with small truncation error on this sub-network, as 
shown in Figl24fa), is less restrictive than the condition 
previously imposed on the projectors in Sect 11VI [which 
used a smaller sub-network], thus potentially allows for 
more accurate projectors to be chosen. The isometric 


tensors {yL^VR^'w} that compose these projectors can be 
chosen to minimize the truncation error 5 by optimiz¬ 
ing them to maximize ||A|| , with tensor A as defined 
in Fig lMT bi. which effectively replaces the two separate 
optimizations depicted previously in Figl6l[d,f). 

We would also like to use the larger sub-network in 
the optimization of the disentangler u. Given that the 
B tensors depend on the disent anglers as depicted 
in Fig|6](b), one could likewise optimize u to maximize 

IIAII . However, the dependance of A on disent anglers u 
is not in a form that is directly compatible with the op¬ 
timization problem discussed in Sect illl Cl To this end, 
we use a modified environment F^^ of u generated from 
IIAII , as depicted in FiglMTci. where the modified envi¬ 
ronments results from the removal of either a pair tensors, 
vlv\ or vrv"^^^ from A. The modified environment is 
now compatible with the previous optimization strategy 
of iterative SVD updates, thus can be used to directly 
replace the previous environment F^ of u from FigCJc). 
Note that F^ can be computed with cost that scales as 
O(x^) in terms of bond dimension x [or O(x^) when 
employing the ideas of Appendix [E] , which is the same 
scaling with x as the basic TNR algorithm discussed in 
SectHS 


Appendix G: Achieving a scale-invariant RG flow 

A novel and useful feature of the TNR approach is 
that, when applied to a scale-invariant critical system, it 
can generate an explicitly scale-invariant RG flow, such 
that tensors at different scales s of coarse-graining are 
equal. 


(Gl) 

up to small differences stemming from truncation errors. 
However, realization of scale invariance requires fixing 
the gauge degree of freedom, which we now discuss. 

Give a square lattice network Q composed of identical 
tensors Aijki there exists a local gauge freedom in the 
network relating to a local change of basis on individual 
indices of the tensor, implemented by unitary matrices x 
and y. 


^ijkl ^ E 

i' j'k'l' 


under which the tensor network remains unchanged. 
[Note, in general the tensor network is invariant under 
changes of gauge implemented by invertible matrices, 
however the more restrictive class of unitary changes of 
gauge is sufficient to consider if reflection symmetry is ex¬ 
ploited, see Appendix m- If the gauge degree of freedom 
is not given proper consideration, application of TNR to a 
scale-invariant critical will not system will not, in general, 
produce an explicitly scale-invariant RG flow, as defined 
by Eq IGH Instead an implicitly scale-invariant RG flow 
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FIG. 24. (a) Isometric tensors i/l, Hr, w yielding a more accu¬ 
rate coarse-graining transformation can found by optimizing 
them to minimize the truncation error when applied to a re¬ 
gion of the network, here containing two copies of the B ten¬ 
sor, that is larger than was previously considered in Fig|6ld,f). 
Notice that minimizing the truncation error is equivalent to 
maximizing the norm of A. (b) Definition of tensor A. (c) 
The two contributions to the modified environment F^ for 
disentangler u, as generated from ||^|| . 


may be given, where the tensors and ^4^^^ differ 

by choice of gauge, even though they are representative 
of the same critical fixed point. [Conversely, it can be 
demonstrated that TRG does not generate an implicitly 
scale-invariant RG flow when applied to a scale-invariant 
system, as certain gauge-invariant properties of tensors 
diverge with RG step 5, see RefQ. We now explain 
how the gauge freedom in TNR can be fixed such that 
an otherwise implicitly scale-invariant RG flow becomes 
explicitly scale-invariant. 

There are many strategies one could employ to fix 
the choice of gauge on tensor to be compatible 

with that on the previous tensor ^4^^^ One possibil¬ 
ity is to include separate gauge-fixing step after each 
coarse-graining iteration that minimizes the difference 
||^(s+i) _ ^(s)|| through optimization of unitary matri¬ 
ces X and y that implement a change of gauge on ^4^^+^^ 
as per EqlSl A different possibility, one that we find 
more convenient, is to include the gauge-fixing as part of 
the tensor optimization described in Sect JIVBl Let 
be the tensor obtained after the first step of the TNR 
iteration on as per FigEl^b), and assume we wish 

to choose a gauge on isometries v^j^\ and disentan¬ 
gler consistent with the previous TNR iteration, i.e. 
such that the choice of gauge on B^^^ takes it as close to 
possible Let us define, 

B = B^^^ (G3) 

for some ^ > 0. Then, during the optimization of 

and , if 5 is used instead of B^^^ in the calculation 
of the tensor environments, FiglHa-c), the optimization 
is biased towards ensuring that the tensors are chosen 
in the same gauge as those at the previous TNR itera¬ 
tion. Typically we take (5 = 1 for the early stages of the 
optimization of tensors v^l\ and but reduce 5 
smaller as the tensors converge. The same strategy can 
then be employed during the optimization of tensors , 
and in the other intermediate steps of the TNR 
iteration to ensure that the gauge on is fixed in a 

way compatible with ^4^^^. 
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